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IN THE CLAIMS: 

The current status of each of the claims remains as follows: 

1 . (Previously Presented) User interaction system, comprising: 

an electrical apparatus; 

a portable pointing device operable by a user for pointing to a region in space; 
a camera taking a picture; and 

a digital signal processor, capable of receiving and processing the picture, recognizing 
an object in the region, and transmitting user interface information derived from the picture to the 
electrical apparatus, 

wherein the camera is connected to the pointing device so that in operation it images 
the region pointed to. 

2. (Previously Presented) User interaction system as claimed in claim 1 , wherein the user 
interface information includes apparatus control data for controlling operation of the electrical 
apparatus. 

3. (Previously Presented) User interaction system as claimed in claim 1, wherein the digital 
signal processor has an object characterizing means for characterizing an object or part of the object 
present in the picture of the region imaged by the camera, by providing first object characterizing 
features to object identification means for identifying the object, and which object identification 
means is capable of outputting object identification data from which the user interface information is 
constructed. 

4. (Previously Presented) User interaction system as claimed in claim 1, wherein the digital 
signal processor comprises: 
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motion trajectory estimation means for estimating a motion trajectory of the pointing 
device and outputting a first motion characterizing signature, a signature being a mathematical 
abstraction of the motion trajectory; and 

signature identification means for identifying the first motion characterizing signature 
and outputting command identification data, which represents a user interaction command, 
corresponding with the first motion characterizing signature, from which command identification 
data the user interface information is constructed. 

5. (Previously Presented) User interaction system as claimed in claim 3, wherein the digital 
signal processor includes identification improvement means, which are capable of further improving 
a probability that the object represented as object identification data, and user interaction command 
represented as command identification data, are more reliably identified based on predetermined 
rules, yielding more reliable user interface information. 

6. (Previously Presented) User interaction system as claimed in claim 5, wherein the 
predetermined rules comprise probabilistic calculation of the likelihood at least one of object 
identification data and command identification data, taking into account a priori known information 
units selected from the group consisting of room in which the pointing device resides, previous 
command issued by user, statistical frequency that a user issues a particular command, time of the 
day, and combinations thereof. 

7. (Previously Presented) User interaction system as claimed in claim 3, wherein the digital 
signal processor includes object association means for providing to the object identification means 
object association data selected from the group consisting of associated object characterizing 
features, and object related data, and combinations thereof; 

wherein the object association data being is derivable from object template data in 
object memory originating from at least one of the methods: 
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the object template data is obtained from object training means performing a 
predetermined calculation on second object characterizing features outputted by the object 
characterizing means; and 

the object template data is derived from inputted object data. 

8. (Previously Presented) User interaction system as claimed in claim 4, wherein the digital 
signal processor includes signature association means for providing to the signature identification 
means signature association data selected from the group consisting of associated signature features, 
command related data, and combinations thereof; 

wherein the signature association data is derivable from signature template data in 
signature memory originating from at least one of the methods: 

the signature template data is obtained from signature training means performing a 
predetermined calculation on a second motion characterizing signature outputted by the motion 
trajectory estimating means; and 

the command template data is derived from inputted command data. 

9. (Original) User interaction system as claimed in claim 4, wherein the first motion characterizing 
signature is derived on the basis of successive pictures imaged by the camera at respective 
instances of time. 

10. (Previously Presented) Pointing device for use in a user interaction system as claimed in 
claim 1 , comprising a camera and being capable of sending a picture to a digital signal processor. 

11. (Original) Pointing device as claimed in claim 10, wherein the pointing device is capable of 
sending a picture to the digital signal processor, which is capable of sending user interface 
information to an electrical apparatus based on the picture. 

12. (Previously Presented) Pointing device as claimed in claim 10 wherein the digital signal 
processor is comprised in the pointing device. 
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13. (Original) Pointing device as claimed in claim 10, comprising motion sensing means for sensing 
a motion trajectory of the pointing device. 

14. (Original) Pointing device as claimed in claim 10, comprising a characteristic projector for 
optically projecting a characteristic pattern towards a region pointed to. 

15. (Original) Pointing device as claimed in claim 10, comprising a programmable user interface 
code generator and a wireless transmitter for transmitting the code to the electrical apparatus. 

16. (Original) Pointing device as claimed in claim 10 comprising feedback means for feedback of 
user interface information. 

17. (Previously Presented) Electrical apparatus for use in a user interaction system as claimed 
in claim 1 , comprising means which allow the electrical apparatus to send information about 
supported commands to a pointing device , based on an a call of the pointing device to the electrical 
apparatus. 

18. (Previously Presented) User interaction system, comprising: 

an electrical apparatus; 

a portable pointing device operable by a user for pointing to a region in space; 

a camera connected to the pointing device so that in operation it images the region pointed to 
for taking a picture; 

motion sensing means for estimating the motion of the pointing device; and 

a digital signal processor, capable of receiving and processing data of said picture, 
recognizing an object in the region, and transmitting user interface information derived on the basis 
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19. (Previously Presented) User interaction system as claimed in claim 18, comprising means for 
estimating the motion trajectory on the basis of the output of said motion-sensing means. 

20. (Previously Presented) User interaction system as claimed in claim 18, wherein the motion of 
the pointing device is estimated on basis of successive pictures imaged by the camera at respective 
instances of time. 

21. (Previously Presented) User interaction system as claimed in claim 18, wherein the motion 
sensing means is selected from the group consisting of a mass on a deformation sensor, a gyroscope 
and a differential GPS. 

22. (Previously Presented) User interaction system as claimed in claim 18 wherein the transmitted 
user interface information includes at least one feature selected from the group consisting of motion 
speed, motion direction, and acceleration of the pointing device. 

23. (Previously Presented) User interaction system as claimed in claim 19, wherein the transmitted 
user interface information includes at least one feature selected from the group consisting of motion 
trajectory of the pointing device and a characteristic signature derived from the motion trajectory of 
the pointing device. 
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24. (Previously Presented) User interaction system as claimed in claim 18, further comprising room 
localization beacons for emitting electromagnetic radiation, wherein the digital signal processor is 
arranged to recognize to which part of the room the pointing device is pointing. 

25. (Previously Presented) User interaction system as claimed in claim 18, wherein the pointing 
device further comprises feedback means for providing the user with additional information. 

26. (Previously Presented) User interaction system as claimed in claim 25, wherein said feedback 
means is selected from the group consisting of light, sound, a display and force feedback means. 

27. (Previously Presented) Pointing device for use in a user interaction system as claimed in claim 
18, comprising a camera and being capable of sending a picture to a digital signal processor. 

28. (Previously Presented) Pointing device as claimed in claim 27, wherein the pointing device is 
capable of sending a picture to the digital signal processor, which is capable of sending user 
interface information to an electrical apparatus based on the picture. 

29. (Previously Presented) Pointing device as claimed in claim 27 wherein the digital signal 
processor is comprised in the pointing device. 

30. (Previously Presented) Pointing device as claimed in claim 27, comprising motion sensing means 
for sensing a motion trajectory of the pointing device. 
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3 1 . (Previously Presented) Pointing device as claimed in claim 27, comprising a characteristic 
projector for optically projecting a characteristic pattern towards a region pointed to. 

32. (Previously Presented) Pointing device as claimed in claim 27, comprising a programmable user 
interface code generator and a wireless transmitter for transmitting the code to the electrical 
apparatus. 

33. (Previously Presented) Pointing device as claimed in claim 27 comprising feedback means for 
feedback of user interface information. 



34. (Previously Presented) User interaction system as claimed in claim 18, further comprising an 
interface means for enabling the electrical apparatus to send information about supported commands 
to a pointing device, based on at least one call of the pointing device to the electrical apparatus. 
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35. (Previously Presented) User interaction system, comprising: 

a first electrical apparatus; 

a portable pointing device operable by a user for pointing to a region in space; 
a camera connected to the pointing device so that in operation it images the region pointed to 
for taking a picture; 

a digital signal processor, capable of receiving and processing data of said picture, 
recognizing an object in the region, and transmitting user interface information derived on the basis 
of said picture data to the first electrical apparatus; and 

an object displaying a characteristic pattern to thereby facilitate recognition of said object by 
the digital signal processor. 

36. (Previously Presented) User interaction system as claimed in claim 35, wherein the object 
displaying a characteristic pattern is a second electrical apparatus. 

37. (Previously Presented) User interaction system as claimed in claim 36, wherein the second 
electrical apparatus comprises a display. 

38. (Previously Presented) User interaction system as claimed in claim 35, wherein the object 
displaying a characteristic partem is the first electrical apparatus. 

39. (Previously Presented) Pointing device for use in a user interaction system as claimed in claim 
35, comprising a camera and being capable of sending a picture to a digital signal processor. 
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40. (Previously Presented) Pointing device as claimed in claim 39, wherein the pointing device is 
capable of 

sending a picture to the digital signal processor, which is capable of sending user interface 
information to an electrical apparatus based on the picture. 

41. (Previously Presented) Pointing device as claimed in claim 39 wherein the digital signal 
processor is comprised in the pointing device. 

42. (Previously Presented) Pointing device as claimed in claim 39, comprising motion sensing means 
for sensing a motion trajectory of the pointing device. 

43. (Previously Presented) Pointing device as claimed in claim 39, comprising a characteristic 
projector for optically projecting a characteristic pattern towards a region pointed to. 

44. (Previously Presented) Pointing device as claimed in claim 39, comprising a programmable user 
interface code generator and a wireless transmitter for transmitting the code to the electrical 
apparatus. 

45. (Previously Presented) Pointing device as claimed in claim 39 comprising feedback means for 
feedback of 
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46. (Previously Presented) Electrical apparatus for use in a user interaction system as claimed in 
claim 35, wherein interface means allow the electrical apparatus to send information about supported 
commands to a pointing device, based on at least one identify supported commands call of the 
pointing device to the electrical apparatus. 

47. (Previously Presented) User interaction system, comprising: 

an electrical apparatus; 

a portable pointing device operable by a user for pointing to a region in space; 
a camera connected to the pointing device so that in operation it images the region pointed to 
for taking a picture; 

a digital signal processor, capable of receiving and processing data of said picture, 
recognizing an object in the region, and transmitting user interface information derived on the basis 
of said picture data to the electrical apparatus; and 

wherein said user interface information includes a specification of the electrical apparatus, or 
of a part of the electrical apparatus intended to be used by the user. 

48. (Previously Presented) User interaction system as claimed in claim 47, wherein the electrical 
apparatus, or the intended part of the electrical apparatus is identified by determining the position of 
the electrical apparatus in the picture of the region pointed to. 
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49. (Previously Presented) User interaction system as claimed in claim 48, wherein the electrical 
apparatus, or the intended part of the electrical apparatus corresponds to a fixed position in the 
picture. 

50. (Previously Presented) User interaction system as claimed in claim 47, further comprising means 
for feedback generation on basis of said transmitted user interface information. 

5 1 . (Previously Presented) User interaction system as claimed in claim 50, wherein the means for 
feedback generation include the generation of visual/auditory signals in proximity to the electrical 
apparatus, or to the intended part of the electrical apparatus. 

52. (Previously Presented) Pointing device for use in a user interaction system as claimed in claim 
47, comprising a camera and being capable of sending a picture to a digital signal processor. 

53. (Previously Presented) Pointing device as claimed in claim 52, wherein the pointing device is 
capable of sending a picture to the digital signal processor, which is capable of sending user 
interface information to an electrical apparatus based on the picture. 

54. (Previously Presented) Pointing device as claimed in claim 52 wherein the digital signal 
processor is operatively associated with the pointing device. 

55. (Previously Presented) Pointing device as claimed in claim 52, comprising motion sensing means 
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56. (Previously Presented) Pointing device as claimed in claim 52, comprising a characteristic 
projector for 

optically projecting a characteristic pattern towards a region pointed to. 

57. (Previously Presented) Pointing device as claimed in claim 52, comprising a programmable user 
interface code generator and a wireless transmitter for transmitting the code to the electrical 
apparatus. 

58. (Previously Presented) Pointing device as claimed in claim 52 comprising feedback means for 
feedback of user interface information. 

59. (Previously Presented) Electrical apparatus for use in a user interaction system as claimed in 
claim 47, comprising means allowing the electrical apparatus to send information about supported 
commands to a pointing device, based on an "identify supported commands" call of the pointing 
device to the electrical apparatus. 

60. (Previously Presented) User interaction system, comprising: 

an electrical apparatus; 

a portable pointing device operable by a user for pointing to a region in space; 
a camera taking a picture; and 

a digital signal processor, capable of receiving and processing the picture, and capable 
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of transmitting user interface information derived from the picture to the electrical apparatus, 
wherein the camera is connected to the pointing device so that in operation it images the region 
pointed to characterized in that the system further comprises at least one localization beacon that can 
emit electromagnetic radiation, which can be captured by the system and for use to the digital signal 
processor in order to recognize to where the pointing device is pointing by using information derived 
from the captured electromagnetic radiation. 

61. (Previously Presented) The user interaction system as in claim 60, wherein the digital signal 
processor is further arranged to recognize the direction of the pointer relative to the localization 
beacon. 

62. (Previously Presented) The user interaction system as in claim 60, further comprising 
motion sensing means for enabling estimating a motion or a motion trajectory of the pointing device. 

63. (Previously Presented) The user interaction system as in claim 60, wherein the motion or 
the motion trajectory of the pointing device is estimated on basis of successive pictures imaged by 
the camera at respective instances of time. 

64. (Previously Presented) User interaction system as claimed in claim 61 wherein the 
transmitted user interface information includes at least one feature selected from the group 
consisting of motion speed, and motion direction of the pointing device. 

65. (Previously Presented) User interaction system as claimed in claim 62, wherein the 
transmitted user interface information includes at least one feature selected from the group 
consisting of motion trajectory of the pointing device and a characteristic signature derived from the 
motion trajectory of the pointing device. 
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66. (Previously Presented) User interaction system as claimed in one of claims 60, wherein the 
pointing device (101) further comprises feedback means for providing the user with additional 
information. 

67. (Previously Presented) User interaction system as claimed in claim 66, wherein said 
feedback means is selected from the group consisting of light, sound, a display and force feedback 
means. 

68. (Previously Presented) User interaction system as in one of claims 60, wherein the user 
interface information comprises apparatus control data for controlling operation of the electrical 
apparatus. 

69. (Previously Presented) Pointing device for use in a user interaction system as in one of 
claims 60, characterized in that it comprises the digital signal processor and a camera and wherein 
the pointing device is capable of sending a picture to the digital signal processor. 

70. (Previously Presented) Pointing device as in claim 69, comprising a characteristic projector 
for optically projecting a characteristic pattern towards a region pointed to. 

71 . (Previously Presented) Pointing device as in claim 60, comprising a programmable user 
interface code generator and a wireless transmitter for transmitting the code to the electrical 
apparatus. 

72. (Previously Presented) Electrical apparatus for use in a user interaction system as in claim 
60, characterized in that interface means are comprised which allow the electrical apparatus to send 
information about supported commands to a pointing device, based on an "identify supported 
commands" call of the pointing device to the electrical apparatus. 
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